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Abstract 



We study stability of interacting nonlinear systems with time-delayed communications, using 
■ contraction theory and a simplified wave variable design inspired by robotic teleoperation. We 

£N) \ show that contraction is preserved through specific time-delayed feedback communications, and 

that this property is independent of the values of the delays. The approach is then applied to 
group cooperation with linear protocols, where it shown that synchronization can be made 
robust to arbitrary time delays. 



1 Introduction 



In many engineering applications, communications delays between subsystems cannot be neglected. 
Such an example is bilateral teleoperation, where signals can experience significant transmission 
delays between local and remote sites. Throughout the last decade, both internet and wireless 
technologies have vastly extended practical communication distances. Information exchange and 
£SJ ' cooperation can now occur in very widely distributed systems, making the effect of time delays even 

more central. 

m 

In the context of telerobotics, proposed a control law for force-reflecting teleoperators which 
preserves passivity, and thus overcomes the instability caused by time delays. The idea was refor- 
mulated in |17| in terms of scattering or "wave" variables. Transmission of wave variables across 
communication channels ensures stability without knowledge of the time delay. Further exten- 
sions to internet-based applications were developed |151 1161 |3| , in which communication delays are 



variable. 



Recently, ^3 |^] extended the application of wave variables to a more general context by 



performing a nonlinear contraction analysis |1 111131 IT1 15] of the effect of time-delayed communications 
between contracting systems. This paper modifies the design of the wave variables proposed in |131 
12 1| . Specifically, a simplified form provides an effective analysis tool for interacting nonlinear systems 
with time-delayed feedback communications. For appropriate coupling terms, contraction as a 
generalized stability property is preserved regardless of the delay values. The result also sheds a new 
light on the well-known fact in bilateral teleoperation, that even small time-delays in feedback PD 
controllers may create stability problems for simple coupled second-order systems, which motivated 
approaches based on passivity and wave variables The approach is then applied to study 

the group cooperation problem with delayed communications. We show that synchronization with 
linear protocols |19l I14| is robust to time delays and network connectivity, without requiring the 
delays to be known or equal in all links. In a leaderless network, all the coupled elements tend to 
reach a common state which varies according to the initial conditions and the time delays, while 
in a leader-followers network the group agreement point is fixed by the leader. The approach is 
suitable to study both continuous and discrete-time models. 
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After brief reviews of nonlinear contraction and wave variables, Section 2 uses simplified wave 
variable forms to analyze timc-dclaycd feedback communications. The same approach is then applied 
in Section 3 to study group cooperation. Concluding remarks are offered in Section 4. 



2 Contraction Analysis of Time-Delayed Communications 

Inspired by the use of passivity [2] and wave variables ^7] in force-reflecting teleoperation, [T3*| 
performed a contraction analysis of the effect of time-delayed communications. As we will discuss 
in this section, the form of the transmitted variables in |13| can be simplified and applied to analyze 
time-delayed feedback communications. 



2.1 Background I: Contraction Theory 

We first summarize briefly some basic definitions and main results of nonlinear contraction the- 
ory |1 II I12j . Consider a nonlinear system 

x = f(x,i) (1) 

with x € R mxl and f(x, t) continuously differentiable. For any virtual displacement 1 <5x between 
two neighboring trajectories, we have 

— ((5x T (5x) = 2 Sx T 6x = 2 6x T ^- 5x < 2 X rnax 6x T Sx 
dt ax 

where X max (yi,t) is the largest eigenvalue of the symmetric part of the Jacobian J = Hence, if 
X max (x, t) is uniformly strictly negative, any infinitesimal length ||<5x|| converges exponentially to 
zero. By path integration at fixed time, this implies that all the solutions converge exponentially to 
a single trajectory, independently of the initial conditions. 

More generally, considering a coordinate transformation 

Sz = QSx (2) 
with square matrix ®(x, t) uniformly invertible, we have 

— (Sz T Sz) = 2 Sz T Sz = 2 6z T (0 + ©i^-)©- 1 Sz 
dt ax 

so that exponential convergence of \\Sz\\ to zero is guaranteed if the generalized Jacobian matrix 

8f 

F = (© + © — )0 1 (3) 
ax 

is uniformly negative definite. Again, this implies in turn that all the solutions of the original 
system JQl converge exponentially to a single trajectory, independently of the initial conditions. 
Such a system is called contracting, with metric & T ®. 

In the sequel, we will also use asymptotical contraction to refer to asymptotic convergence of any 
\\5z\\ to zero, which implies global asymptotic convergence to a single trajectory. 



1 Virtual displacements are differential displacements at fixed time borrowed from mathematical physics and opti- 
mization theory. Formally, if we view the position of the system at time t as a smooth function of the initial condition 
x and of time, x = x(x , t) , then <5x = -S^- dx . 
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2.2 Background II: Wave Variables 



Wave variables J7| are used in bilateral teleoperation systems to guarantee the passivity of 
time-delayed transmissions. The idea was generalized in 1 1 .' jj by conducting a contraction analysis 
on time-delayed transmission channels. As illustrated in Figure ^ |13j considers two interacting 
systems of possibly different dimensions, 



Xl = fl(xi,t) + G21T21 

x 2 = f 2 (x 2 ,£) + G12T12 



(4) 



where Gi 2 , G21 are constant matrices and T12, T21 have the same dimension. Communication 
between the two systems occurs by transmitting intermediate "wave" variables, defined as 



u 2 i 

"12 



G£xi 
Gf 2 x 2 



721 
T12 



V12 = G 21 xi 
'12 3 



V21 — G?oX2 



T21 
T12 



Because of time-delays, one has 

u 12 (f) =via(t-Ti 2 ) 



U21W = v 2 i(t-T 21 ) 



where T12 and T21 are two positive constants. It can be proved that, if both fi and f 2 are contracting, 
the overall system is asymptotically contracting independently of the time delays. 



X, 



v, 



delay T 12 



u, 



u 



delay T 2I 



Figure 1: Two interacting systems with delayed communications 



Note that subscripts containing two numbers indicate the communication direction, e.g., sub- 
script "12" refers to communication from node 1 to 2. This notation will be helpful in Section 
where results will be extended to groups of interacting subsystems. 



2.3 Time-Delayed Feedback Communications 



Let us now consider modified choices of the transmitted variables above. Specifically, for interacting 
systems (@J, define now the transmitted variables as 

"21 = GjiXl + fc 2 lT 2 i V12 = G^Xi (5) 

"12 = Gf 2 X 2 + fci 2 Ti2 v 2 i = Gf 2 x 2 

where fci 2 and fc 2 i are two strictly positive constants. Consider, similarly to |13U24j . the differential 
length 

V = — dxi <5xi + — <5x 2 <5x 2 + - Vi,2 

where 

rt r-t M rO 

V1.2 = I 8-vf 2 5vi2 de + <5v 2 r 1 ^v 2 i de — / SvJ 2 S~vi2 de — SvJiSv2i de 

Jt— T12 •* t— T21 •* —T12 <* — T21 
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Note that 

Vl,2 = 



/ ( <5vf 2 <5vi 2 (e) - 5vJ 2 5v 12 (e - T 12 ) + 5v 21 Sv 21 (e) - 5v 21 5v 21 (e - T 21 ) ) de 
Jo 

( Jvf 2 (5vi 2 (e) - <5uf 2 (5ui 2 (e) + 5v 21 6v 2 i(e-) ~ Su 21 5u 2 i(e) ) de 

2 / ( fc 2i (5xf G 21 St 2 i + ki 2 5x- 2 Gi 2 5T 12 ) de - / ( k 21 dT 21 5T 21 + kl 2 Sr{ 2 STi 2 ) de 
Jo Jo 



This yields 



V 



t <9fi 



folfoq (5X1 

axi 



r)fo P k 2 

7 c T ^ A 2 r- ^21 e T c- 12 c T c 

fci 2 ox 2 - — dx 2 - — 0T 21 dT21 - — 0T 12 dTl 2 
(7X 2 Z Z 



If fi and f 2 are both contracting with identity metrics (i.e., if and are both uniformly 

negative definite), then V < 0, and V is bounded and tends to a limit. Applying Barbalat's 
lemma |23j in turn shows that, if V is bounded, then V tends to zero asymptotically, which implies 
that (5xi, <5x2, (5ti2 and 8t 2 \ all tend to zero. Regardless of the values of the delays, all solutions of 
system (@J converge to a single trajectory, independently of the initial conditions. In the sequel we 
shall assume that V can indeed be bounded as a consequence of the boundedness of V. 

This result has a useful interpretation. Expanding system dynamics (@J using © yields 



xj = f^f) + ^G 21 (Gj 2X2 (t-T 21 ) 
x 2 = f 2 (x 2> t) + ^G 12 ( G£ixi (t-T 12 ; 



GWt) ) 
Gf a x a (t) ) 



so that the above communications in fact correspond to simple feedback interactions. If we assume 
further that xi and X2 have the same dimension, and choose G12 = G21 = G, the whole system is 
actually equivalent to two diffusively coupled subsystems 



X! = h(xut) + £ GG T (x 2 (t-T 21 )- Xl (t) ) 
x 2 = f 2 (x 2 ,t) + ^ GG T (x 1 (t-T 12 )-x 2 (i) ) 



(6) 



Note that constants fci 2 and k 2 i and thus coupling gains along different diffusion directions can be 
different. We can thus state 

Theorem 1 Consider two subsystems, both contracting with identity metrics, and interacting through 
time-delayed diffusion-like couplings 0). Then the overall system is asymptotically contracting. 







1 




x, 










♦ 




delay T, 



Figure 2: Two interacting systems with time-delayed diffusion couplings 



Remarks 



Theorem ^ does not contradict the well-known fact in teleoperation, that even small time- 
delays in bilateral PD controllers may create stability problems for coupled second-order sys- 
tems |3 El El EH which motivates approaches based on passivity and wave variables. In 
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fact, a key condition for contraction to be preserved is that the diffusion- like coupling gains be 
symmetric positive semi-definite in the same metric as the subsystems, as we shall illustrate 
later in this section. 

If there are no delays, i.e., T\q, = T21 = 0, then = 0. Thus, the analysis of the differential 
length yields that 

V = fc 2 i<5xf<5xi + fci 2 £x^<Sx 2 ) < fc 2 i^xf -^-^ x i + ^12^x^-^-5x2 

2 at 0x1 ax 2 

< ^raax ( fc 2 l<5xf (5xi + k^S^ $*-2 ) 

where 

X - I \ < dil \ \ ( d * 2 \ \ 

"•max max! A max { ~ )si "maxi ^ Is ) 

OXi OX 2 

This implies that <5x! and <5x 2 tend to zero exponentially for contracting dynamics ft and f 2 , 
i.e., the overall system is exponentially contracting. 

If fi and f 2 are both contracting and time-invariant, all solutions of system © converge to 
a unique equilibrium point, whose value is independent of the time delays and the initial 
conditions. Indeed, in a globally contracting autonomous system, all trajectories converge to 
a unique equilibrium point m |22| , which implies that if fi and f 2 are both contracting and 
time- invariant, an equilibrium point must exist for system © when Xi 2 = T21 = 0. In turn, 
this point remains an equilibrium point for arbitrary non-zero Ti 2 and T 2 i. Since the delayed 
system © also preserves contraction, all solutions will converge to this point independently 
of the initial conditions and the explicit values of the delays. 

Theorem n can be extended directly to study more general connections between groups, such 
as bidirectional meshes or webs of arbitrary size, and parallel unidirectional rings of arbitrary 
length, both of which will be illustrated through Section |3J Inputs to the overall system can 
be provided through any of the subgroup dynamics. 



Example 2.1 : Consider two identical second-order systems coupled through time-delayed feedback PD 
controllers 

X! +b±! +uj 2 X! = k d (± 2 (t - T21) - Xi(t)) + k p (x 2 (t - T21) - Xl(t)) 

X 2 +b±2+i0 2 X 2 = k d (xi(t - T12) - X 2 (t)) + k p (X!(t - T12) - X 2 (t)) 

with b > 0, to > 0. If T12 = T21 — 0, partial contraction analysis |25l 131 1 shows that x\ and X2 converge 
together exponentially regardless of initial conditions, which makes the origin a stable equilibrium point. 
If Ti2,T2i > 0, a simple coordinate transformation yields 



±1 




uy x - bx x 






— LUXl 


X2 




ujy2 - bx 2 


. & 




— UJX2 



+ K( 
+ K( 



x 2 (t - 


T21) " 




" x x {t) ' 


V2{t~ 


T21) _ 




_ yi(t) . 


x-i(t - 


T12) " 




" x 2 (t) ' 


yi(t- 


T 12 ) _ 




. !»(*) . 



where 



fi 



ujy\ - bx± 

—LUXl 



are both contracting with identity metric 



and 



uy 2 - bx 2 

—UJX2 

However, the transformed coupling gain 



K 



k d 
kp 



is neither symmetric nor positive semi-definite for any k p 7^ 0. Contraction cannot be preserved in this 
case, and the coupled systems turn out to be unstable for large enough delays as the simulation result in 
Figure |SJ a) illustrates. In Figure |SJb) we set k p — so that the overall system is contracting according 
to Theorem □ □ 
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(a). PD Control 




8 
6 
4 
2 

-2 
-4 
-6 
-8 
-10 



(b). D Control 




t(sec) 



20 



40 



60 



Figure 3: Simulation results of two coupled mass-spring-damper systems with (a) PD control and 
(b) D control. Parameters are b — 0.5, oj 2 = 5, T\i = 2s, T21 = 4s, kd = 1> kp = 5 in (a) and k p = 
in (b). Initial conditions, chosen randomly, are identical for the two plots. 



The instability mechanism in the above example is actually very similar to that of the classical 
Smale model |271 l3*T| of spontaneous oscillation, in which two or more identical biological cells, 
inert by themselves, tend to self-excited oscillations through diffusion interactions. In both cases, 
the instability is caused by a non-identity metric, which makes the transformed coupling gains lose 
positive semi-definiteness. Note that the relative simplicity with which both phenomena can be 
analyzed makes fundamental use of the notion of a metric, central to contraction theory. 



2.4 Other Simplified Forms of Wave- Variables 

Different simplifications of the original wave-variable design can be made based on the same choice 
of V, yielding different qualitative properties. For instance, the transmitted signals can be defined 

as 

U 2 1 = G^Xl + fc 2 lT 2 l V12 = - k 21 T 21 

U12 = Gf 2 X 2 + fci 2 Ti2 V21 = - fcl2Tl2 

which leads to 

d( d{ 1 1 

V = /c 2 i(5xf- — 5xi + ki 2 Sx^- — r5x 2 - -5xf G 2 iG 2 r 1 (5xi - -Sx^ Gi 2 G^ 2 Sx 2 
axi c/x 2 2 2 

= <5xf( k 21 ^- - -G 2 iG£ )r5 Xl + 8*T( k 12 ^- - -G 12 Gf 2 )r5x 2 (7) 

and thus also preserves contraction through time-delayed communications. Similarly to the previous 
section, if both fi and f 2 are contracting and time- invariant, the whole system tends towards a 
unique equilibrium point, regardless of the delay values. At this steady state, 1112(00) = vi2(oo) 
and u 2 i(oo) = v 2 i(oo), which immediately implies that 

G 21 xi(oo) = Gf 2 x 2 (oo) 

and, if G12 = G 2 i = G with G of full rank, that 

xi(oo) = x 2 (oo) 
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Thus, contrary to the case JSJ of diffusion-like couplings, the remote tracking ability of wave variables 
is preserved. 



Example 2.2: Consider the example of two second-order systems 

Xl + blXi + Ulfxi = F-21 + F e 
X 2 + b 2 ±2 + = Fl2 

where F e is an external force, and F21, F12 are internal forces undergoing time delays. Performing a 
coordinate transformation, we get new equations 



±1 




uiyi — bixi 

— U1X1 + ^ 


±2 






. V 2 




—OJ2X2 





' 


+ 


F21 




- Wl - 




" " 


+ 


£12 




w 2 



The signals being transmitted are defined as simplified wave variables 



«21 



"12 



&21 „ 

= yi + — F21 

ki2 _ 

= J/2 + F 12 

U>2 



&21 r-, 
Vl2 = F21 

ki2 „ 

«21 = ^12 

CJ2 



Note that here G12 = G21 = 



, and that although the variables y\ and j/2 are virtual, their 

values can be calculated based on x\, xi and K2, ±2- According to the result we derived above, the whole 
system will tend to reach an equilibrium point asymptotically. This point is independent to the time 
delays and satisfies 1/1(00) = 2/2(00), i.e., 



61 , s 

— xi(oo) 



62 , V 

L02 




Figure 4: Simulation results of Example 12.21 with (a). T i2 = T 2 i = and with (b). X12 = 2s, 
T21 = 4s. The parameters are 61 = 62 = 0.5, ujf = = 5, fci2 = &2i = 0.2, and F e = 10. Initial 
conditions, chosen randomly, are identical for the two plots. Convergence to a common equilibrium 
point independent to the time delays is achieved in both cases. 
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Finally note that even if the subsystems are not contracting but have upper bounded Jaco- 
bian, for instance, as limit-cycle oscillators, the overall system still can be contracting by choosing 
appropriate gains such that 




Here the transmission of wave variables performs a stabilizing role. 

There are also other simplified forms of wave variables. For instance, we can define the trans- 
mitted signals as 

U 2 i = G21X1 + &21T21 V12 = fc2lT 2 l 

U12 = Gf 2 X 2 + k 12 Ti2 V 2 i = fcl2Tl2 

If both fi and f 2 are contracting and time- invariant, and if G12 = G 2 i = G with G of full rank, 
the whole system tends towards a unique equilibrium point such that xi(oc) = — X2(oo). 

3 Group Cooperation with Time-Delayed Communications 

Recently, synchronization or group agreement has been the object of extensive literature [5] 111)1 
1181 121)1 12T1 1221 [751 1291 13U| . Understanding natural aggregate motions as in bird flocks, fish schools, or 
animal herds may help achieve desired collective behaviors in artificial multi-agent systems. In our 
previous work |251 131j , a synchronization condition was obtained for a group of coupled nonlinear 
systems, where the number of the elements can be arbitrary and the network structure can be very 
general. In this section, we study a simplified continuous-time model of schooling or flocking with 
time-delayed communications, and generalize recent results in the literature |19l I14j . In particular, 
we show that synchronization is robust to time delays both for the leaderless case and for the leader- 
followers case, without requiring the delays to be known or equal in all links. Similar results are 
then derived for discrete-time models. 

3.1 Leaderless Group 

We first investigate a flocking model without group leader. The dynamics of the zth element is given 

as 

£j = ^2 K 3« ( x i _ x i) i = l,...,n (8) 

j'eA/i 

where Xj 6 M. m denotes the states needed to reach agreements such as a vehicle's heading, attitude, 
velocity, etc. Nl denotes the set of the active neighbors of element i, which for instance can be 
defined as the set of the nearest neighbors within a certain distance around i. Kjj is the coupling 
gain, which is assumed to be symmetric and positive definite. 

Theorem 2 Consider n coupled elements with linear protocol (SJ), The whole system will tend to 
reach a group agreement 

xi(t) = • • • = x„(t) = -(xi(0) + • • • + x„(0)) 
n 

exponentially if the network is connected, and the coupling links are either bidirectional with Kyj = 
Ky, or unidirectional but formed in closed rings with identical gains. 
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Theorem |2 is derived in ED based on partial contraction analysis, and the result can be 
extended further to time- varying couplings (Kj-j = Kji(t)), switching networks (A/i = Mi(t)) and 
looser connectivity conditions. 

Assume now that time delays are non- negligible in communications. The dynamics of the ith 
element then turns to be 

ii = Yl K i* ( X i(*- T i<) -*<(*) ) ( 9 ) 



Theorem 3 Consider n coupled elements 0) with time-delayed communications. Regardless of the 
explicit values of the delays, the whole system will tend to reach a group agreement xi (t) — ■ ■ ■ = 
x„ (t) asymptotically if the network is connected, and the coupling links are either bidirectional with 
Kjj = Ky, or unidirectional but formed in closed rings with identical gains. 

Proof: For notational simplicity, we first assume that all the links are bidirectional with Kjj = 
Ky, but the time delays could be different along the opposite directions, i.e., Tji ^ Ty. Thus, 
Equation can be transformed to 

X; = GjiTji 
3"eAf, 

where Tji and correspondingly are defined as 

Uji = C,',x, + Tji Vij = C',x, (10) 

Uij = G!,X, + Tij Vji = GjjXj 

with Gij = Gji > and Kji = Ky = GyGy . Define 

n i 

where TV = U™ =1 A/i denotes the set of all active links, and Vij is defined as in Section for each 
link connecting two nodes i and j. Therefore 

V = ~\ E (^^+<5r^r u ) 

One easily shows that V is bounded. Thus according to Barbalat's lemma, V will tend to zero 
asymptotically, which implies that, V(i, j) G N, Srji and (fry tend to zero asymptotically. Thus, we 
know that Vi, 5xi tends to zero. In standard calculus, a vanishing <5xi does not necessarily mean 
that Sxi is convergent. But it does in this case because otherwise it will conflict with the fact that 
5xi tends to be periodic with a constant period Tji + Ty , which can be shown since 

5uji{t) = GjtSxiit) + STji(t) = CJ.'/x,:/ T„) (12) 
Suij(t) = GfjSxjW + STijit) = G%6x i (t-T ij ) 

From i|12|) we can also conclude that, if Vz <5xi is convergent, they will tend to a steady state 

(5xi (t) = ■ • • = 5x n (i) = c 

where c is a constant vector whose value dependents on the specific trajectories we analyze. More- 
over, we notice that, in the state-space, any point inside the region xi = • • • = x„ is invariant to 
((HI. By path integration, this implies immediately that, regardless of the delay values or the initial 
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conditions, all solutions of the system will tend to reach a group agreement xi — ■ ■ ■ = x„ 
asymptotically. 

In case that coupling links are unidirectional but formed in closed rings with coupling gains 
identical in each ring, we set 

1 " 1 f* f° 

V = - V Jxf <5x 4 + - V ( SvJiSvjide - / 5vJ^ Vji de ) 

1 ™ 1 /"* 

= -^kf&, + - J2 (Sv%Sv ii {e)-5vJ i 8v ji (e-T ji ))de 

and the rest of the proof is the same. The case when both types of links are involved is similar. □ 

Example 3.1: Compared to Theorem |5J the group agreement point in Theorem [3] generally does not 
equal the average value of the initial conditions, but depends on the values of the time delays. 

Consider the cooperative group @ with one-dimensional Xj, n = 6, and a two-way chain structure 

l-< ^2-* ^3-* s-4-< ^5-< ^6 

The coupling gains are set to be identical with value k — 5. The delay values are different, and each is 
chosen randomly around 0.5 second. Simulation results are plotted in Figure O 



(a). Without Delays (b). With Delays 




Figure 5: Simulation results of Example 13.11 without delays and with delays. Initial conditions, 
chosen randomly, are the same for each simulation. Group agreement is reached in both cases, 
although the agreement value is different. 

Remarks 

• The conditions on coupling gains can be relaxed. For instance, if the links are bidirectional, 
we do not have to ask Kjj = Kji. Instead, the dynamics of the ith element could be 

X,; = K, ^ ( (t — T^i) — Xi(t) ) 
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where = j-GG T and G is unique through the whole network. The proof is the same except 
that we incorporate hi into the wave variables and the function V. Such a design brings more 
flexibility to cooperation-law design. The discrete-time model studied in Section [3.31 in in this 
spirit. A similar condition was derived in 0] for a swarm model in the no-delay case. 

• Model ijHJl with delayed communications was also studied in (T^j, but the result is limited by 
the assumptions that communication delays are equal in all links and that the self-response 
part in each coupling uses the same time-delay. Recently, ^3] independently analyzed the 
system © in the scalar case with the same assumption that delays are equal in all links. 

3.2 Leader- Followers Group 

Similar analysis can be applied to study coupled networks with group leaders. Consider such a 
model 

Xj = ^2 K i» ( x i(* - T ji) ~ *,•(*)) + 7« K o-i (x - Xj) i=l,...,n (13) 

where Xo is the state of the leader, which we first assume to be a constant. Vi, Xj are the states of the 
followers; A/i indicate the neighborship among the followers, where time-delays are non-negligible in 
communications; ji — or 1 represent the unidirectional links from the leader to the corresponding 
followers. For each non-zero ji, the coupling gain Koi is positive definite. 

Theorem 4 Consider a leader-followers network fi/jj) with time-delayed communications. Regard- 
less of the explicit values of the delays, the whole system will tend to reach a group agreement 

xi(t) = • • ■ = x„(t) = x 

asymptotically if the whole network is connected, and the coupling links among the followers are 
either bidirectional with K,-j = K.y, or unidirectional but formed in closed rings with identical 
gains. 

Proof: Exponential convergence of the leader-followers network 113|) without delays has been shown 
in |2] using contraction theory. If the communication delays are non-negligible, and assuming 
that all the links among the followers are bidirectional, we can transform the equation Ijl3(l to 

Xj = ^2 GjiTji + 7i K j (x - Xi) 

where Tji and correspondingly are defined as the same as those in H10[) . Considering the same 
Lyapunov function V as (|TT|l . we get 

" 1 
V = - ^2ji8xfK 0i 5xi - - ^ {drj^Tji + St^St^) 

where Af = U" =1 A/i denotes the set of all active links among the followers. Applying Barbalat's 
lemma shows that, V will tend to zero asymptotically. It implies that, Vi if ji — 1, <5xj will tend to 
zero, as well as Srji and Sxij V(i, j) G N. Moreover, since 

8r 0l (t) = GKSxjit-Tji) - Sxi(t) ) 

we can conclude that, if the whole leader-followers network is connected, the virtual dynamics will 
converge to 

<5 Xl (i) = ... = «5x„(i) = 
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regardless of the initial conditions or the delay values. In other words, the whole system is asymp- 
totically contracting. All solutions will converge to a particular one, which in this case is the point 
Xi(i) = • ■ ■ = x„(t) = Xo. The proof is similar if there are unidirectional links formed in closed 
rings. □ 



Example 3.2: Consider a leader-followers network with one-dimensional x*, n — 6, and structured 
as 

s- 1 -< 2 -* >■ 3 < ^4-< ^5 < >- 6 

The state of the leader is constant with value xo = 10. All the coupling gains are set to be identical 
with value k = 5. The delay values are not equal, each of which is chosen randomly around 0.5 second. 
Simulation results are plotted in Figure [S] d 




Figure 6: Simulation results of Example 13.21 without delays and with delays. Initial conditions, 
chosen randomly, are the same for each simulation. In both cases, group agreement to the leader 
value xo is reached. 



Note that even if Xo is not a constant, i.e., the dynamics of the ith element is given as 

ii = K a _ T oi) ~ *<(*)) + n K o* ( x o( f - T m) - x<(t)) 

the whole system is still asymptotically contracting according to exactly the same proof. Regardless 
of the initial conditions, all solutions will converge to a particular one, which in this case depends 
on the dynamics of Xo and the explicit values of the delays. Moreover, if Xo is periodic, as one of 
the main properties of contraction [TI], all the followers' state Xj will tend to be periodic with the 
same period as xq. 



Example 3.3: Consider the leader-followers network in Example 13.21 again. We set everything the 
same except that the leader's states is not constant. Instead, we choose 

xo = 10 sin(-) 

The whole system is still asymptotically contracting regardless of the delays 
plotted in Figure 



Simulation results are 
□ 
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(a). Without Delays (b). With Delays 




Figure 7: Simulation results of Example 13.31 without delays and with delays. In both plots, the 
dashed curve is the state of the leader while the solid ones are the states of the followers, which 
converge to a periodic solution in both cases regardless of the initial conditions. 



3.3 Discrete-Time Models 

Simplified wave variables can also be applied to study time-delayed communications in discrete-time 
models. Consider the model of flocking or schooling studied in OEOj) where each element's state is 
updated according to the discrete-time law that computes the average of its neighbors' states plus 
its own state, i.e., 

if<(t + l) = -—(xi{t) + V.^(<)) i = l,...,n (14) 

1 + Tli ^-^ r 

or, in an equivalent form 

Xi{t+1) = Xi {t) + —— V ( Xj (t) - Xi {t) ) 

In fact, in equation Q14JI. there is no difference if Xi is a scalar or a vector. For notation simplicity we 
set Xi as a scalar, but our analysis can be extended directly to the vector case. In equation (|14f) . t 
is the index of the updating steps, so that its value is always an integer. Mi denotes the set of the 
active neighbors of element i, which for instance can be defined as the set of the nearest neighbors 
within a certain distance r around i. equals to the number of the neighbors of element i. As 
proved in |5] , the whole system l|14fl will tend to reach a group agreement if the network is connected 
in a very loose sense. 

Assume now that time delays are non-negligible in communications. The update law of the ith 
element changes to 

Xi (t+1) = Xi (t) + —J— Y, ( X i(t-Tji) - (15) 

1 -r 7li 

where the delay value Tji is an integer based on the number of updating steps. As in previous 
sections, Tji could be different for different communication links, or even different along opposite 
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directions on the same link. For our later analysis, here we make a few assumptions: all elements 
update their states synchronously, and the time interval between any two updating steps is a con- 
stant; the network structure is fixed and always connected, which implies that Vz, ni is a positive 
integer; the value of neighborship radius r is unique through the whole network, which leads to the 
fact that all interactions are bidirectional. 



Theorem 5 Consider n coupled elements y3J) with time-delayed communications. Regardless of 
the explicit values of the delays, the whole system will tend to reach a group agreement x\(t) = ■ ■ ■ = 
x n (t) asymptotically. 



Proof: See Appendix. □ 

Similarly, consider the discrete-time model of a cooperating group with a leader-followers struc- 
ture, where the dynamics of the zth follower is given as 

Xi(t + 1) = — — — ( Xi(t) + Xj(t-Tji) + 7^0) 

1 + n *+~f* tit. 



i(t) + E T #® + i , „ , so 



1 + rii + ji 1 + ni + 7, 

and Tji is defined as in with fej = 1 + n, + 7, and 7, = or 1. One easily shows that a very 
similar analysis leads to the same result as that of Theorem 0J 



4 Concluding Remarks 



Modified wave variables are analyzed in this paper, and are shown to yield effective tools for con- 
traction analysis of interacting systems with time-delayed feedback communications. Future work 
on time-delays includes the development of analysis tools for general nonlinear systems, coupled 
networks with switching topologies, and time- varying time delays. 



Appendix: Proof of Theorem [5] 



Equation i|15fl can be transformed to 



= xi(t) + e r J*w 



where the wave variables are defined as 



^ji ~1~ k'lTji X-i 



and ki = 1 + Ui . Note that compared to IjlUI) , here we have Gy = Gji = 1 (the cooperation law 
could be extended to a more general form). Define 



v(t) = Y, k M{t) + E V <M 

i=l {i,j)£Af 



where V(i, j) S JV = Uf =1 M 



t-i 



vu® = e <H( £ ) + E Sv U") - E 5v U') - E 5v U") 

e=i-l-Ty e=t-l-Tji e=— Ty 6=— Tji 
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and therefore 

t-i 

£=0 

t-1 

= - E( 2k i Sx i 5T j i(e) + k?5Tji(e) + 2k j Sx j 5r i j(e) + fc|<k§(e) ) 

Since 

5] (V w (t+1) - VSjW) = - ^ (2^(5^;^) + fc?^-(t) + 2fc j fe i 5r ij (t) + kprf^t) ) 



one has 



n 

E (2fc 4 ^ ^^(t) + fc 4 2 2 



Note that 



n 

= v(t) + e> ( ( E ) 2 - E ^(*) ) 



( e ) 2 - *i E ^ = 



i ••• i 



i • • • i 

-n, 1 

1 -71,- 



< - srf sr t 

where £T; = [• • • , (Jt^, ■ • ■ ] T e R" ! , so that 



- Mif ar, 



i 
i 

5r, : 



1 1 



< - e> E^w 

i=l j'eA/i 

Since V is lower bounded it converges to a finite limit as t — > +oo, which implies that V(i, j) G TV, 
5rjj tends to zero, which in turn implies that Vi, 5xi tends to zero. The rest of the proof is then 
similar to that of Theorem [3J 



References 

[1] Aghannan, N., Rouchon, P., An Intrinsic Observer for a Class of Lagrangian Systems, I.E.E.E. Trans. Aut. 
Control, 48(6) (2003). 

[2] Anderson, R., and Spong, M.W. (1989) Bilateral Control of Teleoperators, IEEE Trans. Aut. Contr., 34(5),494- 
501 

[3] Chopra, N., Spong, M.W., Hirche, S., and Buss, M. (2003) Bilateral Teleoperation over the Internet: the Time 
Varying Delay Problem, Proceedings of the American Control Conference, Denver, CO. 



15 



[4] Chu, T., Wang, L., and Mu, S. (2004) Collective Behavior Analysis of an Anisotropic Swarm Model, The 16th 
International Symposium on Mathematical Theory of Networks and Systems, Belgium 

[5] Egeland, O., Kristiansen, E., and Nguyen, T.D., Observers for Euler-Bernoulli Beam with Hydraulic Drive, 
I.E.E.E. Con}. Dec. Control (2001). 

[6] Ficrro, R., Song, P., Das, A., and Kumar, V. (2002) Cooperative Control of Robot Formations, in Cooperative 
Control and Optimization: Series on Applied Optimization, Kluwer Academic Press, 79-93 

[7] Godsil, C, and Royle, G. (2001) Algebraic Graph Theory, Springer 

[8] Horn, R.A., and Johnson, C.R. (1985) Matrix Analysis, Cambridge University Press 

[9] Jadbabaic, A., Lin, J., and Morse, A.S. (2003) Coordination of Groups of Mobile Autonomous Agents Using 

Nearest Neighbor Rules, IEEE Transactions on Automatic Control, 48:988-1001 
[10] Leonard, N.E., and Fiorelli, E. (2001) Virtual Leaders, Artificial Potentials and Coordinated Control of Groups, 

40th IEEE Conference on Decision and Control 
[11] Lohmiller, W., and Slotine, J.J.E. (1998) On Contraction Analysis for Nonlinear Systems, Automatica, 34(6) 
[12] Lohmiller, W. (1999) Contraction Analysis of Nonlinear Systems, Ph.D. Thesis, Department of Mechanical 

Engineering, MIT 

[13] Lohmiller, W., and Slotine, J.J.E. (2000) Control System Design for Mechanical Systems Using Contraction 

Theory, IEEE Trans. Aut. Control, 45(5) 
[14] Morcau, L (2004) Stability of Continuous-Time Distributed Consensus Algorithms, submitted 
[15] Niemeyer, G., and Slotine, J.J.E. (2001) Towards Bilateral Internet Teleopcration, in Beyond Webcams: An 

Introduction to Internet Telerobotics, eds. K. Goldberg and R. Sicgwart, The MIT Press, Cambridge, MA. 
[16] Niemeyer, G., and Slotine, J.J.E. (1998) Towards Force-Reflecting Teleoperation Over the Internet, IEEE Conf. 

on Robotics and Automation, Leuven, Belgium 
[17] Niemeyer, G., and Slotine, J.J.E. (1991), Stable Adaptive Teleoperation, IEEE J. of Oceanic Engineering, 16(1) 
[18] Olfati-Saber, R., and Murray, R.M. (2003) Consensus Protocols for Networks of Dynamic Agents, American 

Control Conference, Denver, Colorado 
[19] Olfati-Saber, R. , and Murray, R.M. (2004) Consensus Problems in Networks of Agents with Switching Topology 

and Time-Delays, to appear in the special issue of the IEEE Transactions On Automatic Control on Networked 

Control Systems 

[20] Pikovsky, A., Rosenblum, M., and Kurths, J. (2003) Synchronization: A Universal Concept in Nonlinear Sciences, 
Cambridge University Press 

[21] Reynolds, C. (1987) Flocks, Birds, and Schools: a Distributed Behavioral Model, Computer Graphics, 21:25-34 
[22] Slotine, J.J.E. (2003) Modular Stability Tools for Distributed Computation and Control, International Journal 

of Adaptive Control and Signal Processing, 17(6) 
[23] Slotine, J.J.E., and Li, W. (1991) Applied Nonlinear Control, Prentice Hall 

[24] Slotine, J.J.E., and Lohmiller, W. (2001), Modularity, Evolution, and the Binding Problem: A View from 
Stability Theory, Neural Networks, 14(2) 

[25] Slotine, J.J.E., and Wang, W. (2003) A Study of Synchronization and Group Cooperation Using Partial Con- 
traction Theory, Block Island Workshop on Cooperative Control, Kumar V. Editor, Springer- Verlag 

[26] Slotine, J.J.E., Wang, W., and El-Rifai, K. (2004) Contraction Analysis of Synchronization in Networks of 
Nonlinearly Coupled Oscillators, Sixteenth International Symposium on Mathematical Theory of Networks and 
Systems, Belgium 

[27] Smale, S. (1976) A Mathematical Model of Two Cells via Turing's Equation, in The Hopf Bifurcation and Its 

Applications, Spinger-Verlag, 354-367 
[28] Strogatz, S. (2003) Sync: The Emerging Science of Spontaneous Order, New York: Hyperion 
[29] Tanner, H., Jadbabaie, A., and Pappas, G.J. (2003) Coordination of Multiple Autonomous Vehicles, IEEE 

Mediterranian Conference on Control and Automation, Rhodes, Greece 
[30] Vicsck, T., Czirok, A., Ben-Jacob, E., and Cohen I. (1995) Novel Type of Phase Transition in a System of 

Self-Driven Particles, Phys. Rev. Lett., 75:1226-1229 
[31] Wang, W., and Slotine, J.J.E. (2003) On Partial Contraction Analysis for Coupled Nonlinear Oscillators, NSL 

Report 030100, MIT, Cambridge, MA, to be published in Biological Cybernetics. 
[32] Wang, W., and Slotine, J.J.E. (2004) Where To Go and How To Go: a Theoretical Study of Different Leader 

Roles, NSL Report 040202, MIT, Cambridge, MA, submitted 
[33] Xie G., Wang L. (2004) Stability and Stabilization of Switched Linear Systems with State Delay: Continuous- 
Time Case, The 16th International Symposium on Mathematical Theory of Networks and Systems, Belgium 
[34] Xie G., Wang L. (2004) Stability and Stabilization of Switched Linear Systems with State Delay: Discrete-Time 

Case, The 16th International Symposium on Mathematical Theory of Networks and Systems, Belgium 



16 



